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LOGISTIC  ANALYSIS  OP  BRUCETON  DATA 

By 

L.  D.  Hampton,  o.  D.  alum,  J.  N .  Ayraa 


ABSTRACT]  A  detailed  study  of  the  Bruceton  test  is  presented  when 
the  logistic  distribution  rather  than  the  Gaussian  is  assumed.  Included 
are<  recapitulation  of  underlying  statistical  concepts;  discussion  of 
the  strategy  and  technique  for  performing  logit  Bruceton  tests;  details 
of  logit  Bruceton  data  anlysis;  derivation  of  asymptotic  equations  for 
the  logit  Bruceton  analysis;  and  Monte  Carlo  tests  which  show  good 
agreement  with  theory  for  very  large  samples,  but  considerable  differ¬ 
ences  when  ordinary  sample  sizes  are  used. 
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LOGISTIC  ANALYSIS  OF  BRUCETON  DATA 

previous  work  has  shown  that  there  are  numt  ous  occasions  where 
sensitivity  data  should  be  interpreted  with  the  logistic  rather  than 
the  normal  (Gaussian)  as  the  assumed  distribution  function.  One  of 
the  tools  for  collecting  and  assessing  sensitivity  data  is  the 
Bruceton  test  and  analysis  method.  The  analysis,  as  it  was 
originally  developed,  assumes  the  normal  distribution. 

This  report  contains  a  theoretical  development  and  study  of  a 
Bruceton  analytical  method  assuming  the  logistic  distribution 
function.  Also,  Monte  Carlo  techniques  were  used  to  study  the 
accuracies  of  the  estimating  parameters  and  how  the  accuracies  are 
affected  by  sample  size.  Although  the  work  was  begun  over  seven 
years  ago  under  the  HERO  (Hazards  of  Electromagnetic  Radiation  to 
Ordnance)  Project,  Task  N0L-443/NWL  and  completed  somewhat  later 
under  Ordtask  Ord-033  234/C92-1/F008-08-11  Problem  001,  Reliability 
and  Gap  Sensitivity  of  Explosives,  it  was  not  published  because  two 
of  the  authors  left  the  Laboratory.  The  methods  described  are  of 
continuing  utility  however  and  warrant  publication. 

Since  the  Bruceton  test  method  is  widely  used  for  collecting 
oensitivity  data  for  predictions  of  safety  and  reliability,  this 
work  should  bo  of  interest  to  systems  analysts  as  well  as  to  those 
working  directly  with  explosives  in  the  fields  of  research,  design, 
and  manufacturing  quality  control. 


ROBERT  WILLIAMSON  II 

i :  ' 

C.  J.  ARONSON 
By  direction 
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I.  INTRODUCTION 


1.  The  statistical  treatment  of  experimental  result*  in  which  the 
response  of  an  item  to  a  stimulus  is  of  a  quantal  (yea  or  no)  nature 
i*  becoming  an  increasingly  important  problem  in  current  research. 

The  Bruceton  test  was  designed  to  handle  lust  such  experiment*  when 
the  stimulus  is  continuously  controllable^'**.  It*  sequential,  "up- 
and-down,"  method  of  testing  is  ideally  suited  to  destructive  testing 
(any  situation  in  which  each  item  can  only  be  tested  once)  becaua^  it 
tends  to  be  economical  in  the  number  of  iteme  consumed  in  testing  . 
This  economy  has  led  to  its  baing  used  extensively  in  explosives 
technology  and,  to  some  degree,  in  the  field  of  experimental  biology/ 
medicine . 


2.  Another  recent  development  in  statistical  data  analysie  is  the 
increased  use  of  the  logistic  distribution* .  The  expression  for  the 
cumulative  logistic  probability  is 


i  \  *  1  ' 

P(X)  =  s-  - 

^  Li+cosh 


'  x- 

V 


rix 


VJ  *vj 


L  +£xp-( 


X  —  u 


(1) 


This  distribution  hao  been  shown  to  be  preferable  to  the  normal**  in 
jertain  applications4 ' 6  . 


j.  Barlier  ’vork  on  tho  Bruceton  teat  has  bated  the  calculations  on 
the  assumption  that  the  population  from  which  the  iteme  under  test  art 
drawn  is  normally  distributed4 ' 3  .  Part  II  is  a  recapitulation  of  the 
statistical  concepts  that  we  use  in  the  ensuing  presentation*.  Those 
with  an  active  familiarity  with  the  field  of  statistics  of  attribute* 
can  skim  or  skip  thi»  section.  Pert.  Ill  iu  a  discussion  of  tne 
strategy  and  technique  for  carrying  out  a  Bruceton  test  and  analyzing 
the  results.  The  disc imilaritie*  between  the  Oauesian-Bruceton  and 
the  logietic-Bruceton  analyses  ■,~e  pointed  out.  Two  numerical  example* 
nr*  used  to  demonstrate  the  •  of  a  Bruceton  analysis.  The  graphs 

arid  tables  used  in  carrying  ou  a  logistic  Bruceton  analysis  are 
collected  into  one  place  (Appendix  A)  along  with  a  summary  of  appro¬ 
priate  equations  to  aid  in  the  carrying  out  of  the  analyses  of 
experimental  data.  Part  IV  of  this  paper  is  a  redevelopment  of  the 
calculational  procedure  of  the  Bruceton  tent  using,  as  a  basic 
assumption,  the  hypothesis  that  the  population  is  logisticaliy  distri¬ 
buted.  Part  V  is  a  report  of  an  extensive  serLes  of  Monte  Carlo  tests 
of  the  logiatic-Bruceton  analysis,  showing  the  effects  of  finite 
sample  size  and  related  factors  on  the  theoretical  assumptions. 


*Ee  Terences  are  on  page  4^7 
**The  comparable  expression 

"•*  1  r 

p(x)  ■  - -  exp 

“  0/2n  *- 

—at 


for  the 

1  r  x  -  u' 
3  .  7 


Gaussian 

» 

dj 


distribution  is 


(2) 
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II.  STATISTICAL  BACKGROUND 
Crit j  cal  Level 


4.  Implicit  in  the  following  methodology  ia  the  concept  of  "critical 
level".  An  exploaive  system  will  respond  if  the  appropriate 
triggering  signal  is  large  enough.  There  it  some  signal  amplitude 
below  which  the  system  will  not  respond  but  at  which,  or  above,  it 
will  respond.  This  signal  amplitude  is  the  critical  level.  A  group 
of  explosive  systems,  even  whan  made  as  nearly  identical  to  each 
other  as  humanly  possible,  cannot  be  expected  to  have  identical 
critical  levels.  In  general  the  critical  levels  will  be  grouped 
around  a  central  value,  some  being  further  away  (above  end  below) 
then  others . 


Distribution 


5.  Experience  has  shown  that  thia  grouping,  or  distribution,  can  be 
represented  by  a  bell -shaped  plot,  as  in  pig  1.  Here  p(x)  represents 
the  relative  probability  of  encountering  a  davice  whosa  critical 
lavel  ia  preciaely  equal  to  the  stimulus,  x.  If  the  curve  is 


F!G.  '  A  ?  jNC’IC’'*  PI<P;-JE\CY  P!.CT' 
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symmetrical,  the  median,  mode,  and  m?an*  all  fall  on  the  sam«* 
stimulus  level  (p  in  Fig  1).  The  Greek  letter  u  is  defined  aa  the 
mean  of  the  population!  the  population  being  all  poaaible  devices 
that  have  been  made,  that  exiat,  or  that  will  be  made. 

Dosage  va  Stimulus 

6.  We  distinguish  between  dosage  and  stimulus.  The  term  "dosage * 
is  reserved  to  designate  the  magnitude  of  the  physical  parameter 
which  the  experimenter  adjusts  to  apply  the  desired  signal  to  the 
explosive  system.  The  stimulus,  which  is  some  conformal  function 
of  the  dosage,  serves  to  transform  the  probability  density  function 
to  some  assumed  distribution,  which  in  the  present  cassis  the  logistic. 
Without  this  transformation  the  statistical  method  to  be  used  would 
not  be  valid. 

7.  As  an  example  of  this  difference!  EED's  can  be  fired  from  a 
charged  capacitor.  The  dosage  might  be  the  potential  to  which  the 
capacitor  is  charged,  or  the  stored  energy.  But  from  the  properties 
of  the  logistic  p.d.f.  (probability  density  function),  namely  that 
the  curve  approaches  zero  probability  as  x  approaches  the  limits  of 
minus  and  plus  infinity,  we  are  confronted  by  a  logical  inconsistency. 
The  idea  of  firing  an  EED  with  negative  energy  has  no  meaning.  By 
taking  the  logarithm  of  the  energy  as  the  stimulus  we  force  the 

lower  asymptotic  limit  to  be  zero  energy.  While  there  are  many 
other  transforms  which  could  be  used  this  is  one  of  the  simplest  and 
has  been  used  quite  widely. 


*The  mean  is  defined  as  (Lx)/n.  That  is,  if  we  have  a  group  of 
values,  observations,  or  measurements  (xx , x, , x, , etc)  the  mean  would  be 
the  total  of  the  magnitudes  of  the  observations  divided  by  the  number 
of  observations.  The  mode  is  the  particular  x  (or  interval  about  x) 
for  which  there  is  the  greatest  number  of  observations.  The  median  is 
the  particular  x  which  divides  the  group  into  upper  and  lower  halves. 
Unless  we  are  dealing  with  an  absolutely  symmetrical  distribution  we 
cannot  expect  these  three  measures  of  central  tendency  to  be  the  same 
(especially  for  small  groups) .  For  instance,  in  this  group  of  fifteen 
numbers  t 

0,6,7,7,7,7,7,8,9,9,9,10,12,15,16 

we  find  that  the  mean  is  9,  the  mode  is  7,  and  the  median  is  3.  There¬ 
fore,  the  level  of  stimulus  in  a  Go/No-Go  test  at  which  50%  response 
is  observed  (or  expected)  is  the  median.  To  refer  to  this  level  as 
the  mean  is  correct  only  if  the  distribution  is  symmetrical  about  the 
median . 
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Probability  Density  function 

8.  The  probability  density  function  la  not  particularly  uaaful  whan 
working  with  exploaivaa  since  we  can  never  know  the  critical  level 
of  each  individual  explosive  unit.  Por  instance,  let  us  take  b 
representative  sample  from  the  population  of  Pig  1.  To  each  member 
of  the  b  \raplo  we  apply  a  particular  stimulus,  xt .  Those  ..embers  whose 
critical  levels  are  equal  to  or  less  than  xx  will  respond.  The  nut&er 
of  members  responding  is  represented  in  rig  2  by  area  a.  The 
remaining  members  of  the  sample  will  not  respond  (area  b) . 


f  G  .  2  RESPONSE  TO  A  PARTICULAR  STIMULUS 


But  once  the  members  of  area  a  have  responded  they  no  longer  exist. 

We,  therefore,  cannot  find,  for  any  member,  whether  or  not  it  would 
have  responded  at  a  lower  level.  Nor  can  we  assume  (without  some 
independent  source  of  information)  that  the  members  which  did  not 
respond  were  not  changed  as  a  result  of  being  subjected  to  stimulus  xx  . 
We  car.  only  assume  that  they  may  have  been  changed  and  therefore  are 
no  longer  members  of  the  population  from  which  the  original  sample  was 
drawn. 


Cumulative  Probability  function 

9,  To  compute  area  a,  Pig  2,  we  need  to  integrate  the  p.d.f.  from  the 
negative  limit  up  to  x;  .  A  plot  of  the  integral  of  the  p.d.f.  for  all 
values  of  x  ranging  from  x  -  to  x  ■  +•  gives  a  cumulative  curve, 
such  as  in  Pig  3.  Prom  this  curve  we  can  deduce  the  proportion  of 
the  population  that  would  respond  if  the  entire  population  were  sub¬ 
jected  to  a  particular  stimulus  level  A  The  population  proportion  that 
would  respond  can  be  considered  as  either  the  expocced  fractional 
response  of  a  finite  sample  to  a  given  stimulus  or  the  expected  proba¬ 
bility  of  response  of  a  particular  ita.n  to  the  same  stimulus. 

♦Deriving  the  cumulative  form  by  integration  of  the  p.d.f.  applies 
strictly  to  the  Gaussian  distribution  since,  as  a  matter  of  history, 

^tlSuia?ive^form3tr^bUt^0n  waS  conct*-veri  *nd  only  used  in  the 

4 
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The  Gaussian  and  Logistic  Distributions 

10.  In  Table  1  we  compare  the  mathematical  expressions  for  the 
p.d.f.'s  and  their  integrals  for  the  time-honored  Gaussian  (or  normal) 
distribution  and  for  the  logistic  function  that  we  will  employ  in 
this  paper. 

Table  1 


Comparison  of  the  Gaussian  and  Logistic  Functions 


oaussian  p.d.f. 


p.(x)  - 


exp 


a  _ 

-U-N  ^ 


[-  Yrjj,  j 

VjTfr 


(3) 


Logistic  p.d.f. 


p(x)  m  ft  ( 


1+coahl 


1  _ > 

'x-uN  y 


(4) 


Y  y 


Gaussiar.  Cumulative  Form 


Logistic  Cumulative  Form 


P(x)  - 


*  exp[-  ]*» 
I  <r/5TH 


(2) 


P(x) 


l+expf  7*^ 

L  ^  Y  ^  j 


(i) 


The  evaluation  of  the  Gaussian  integral,  in  tabular  form,  is 
available  in  many  collections  of  mathematical  tables.  Because  the 
Integra)  cannot  be  evaluated  in  closed  form  the  use  of  the  Gaussian 
function  in  high-speed  computer  programs  depends  upon  either  tabular 
look-up  (which  is  apt  to  be  inefficient  in  computar  storage  space  and 
processing  time)  or  else  approximation  expressions  (which  have  to  be 
devised  or  found) .  on  the  other  hand,  the  logistic  cumulative  and 
its  transformations  involve  only  logarithmic  and  exponential  functions 
which  are  already  available  in  moat  machine  languages. 

Probability  Space 

11.  Even  the  cumulative  curve  shown  in  Fig  3  ia  not  in  its  moat 
useful  form.  The  vertical  axis  can  be  transformed  ao  that  the  MessH- 
ahaped  curve  changes  to  a  straight  line,  as  in  Fig  4.  we  shall  uae 
the  symbol,  L(x),  to  indicate  the  logit  of  x  •••  the  value  of  the 
transformation  of  p(x).  The  logit  transform  can  be  expressed  in  a 
number  of  equivalent  forms : 
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(5a) 

(5b) 

Y 

(5c) 

where  u  i»  the  mean  and  Y  is  the  variability  parameter, 
algebraic  manipulations  the  preceding  equations  can  be 
p(x)  » 

By  simple 
solved  fcr 

P(x)  _ /'x-vA 

exp  \  yv 

(6) 

p(x)  ■  — — r  /x-uM 

““Vvw  J 

(7) 

which  can  be  differentiated,  aa  ia  shown  in  Appendix  B,  to  yield  the 
probability  denaity  function,  Sq  (4)  or  Eq  (B-13)  .  Even  though 
Berkson*  expressed  the  logit  transform  aw  a  conventional  linear 
equation,  L (x)  ■  ax+b,  we  prefer  and  will  use  the  form  of  Eq's  (5) . 

The  nature  of  the  straight-line  transformation  can  be  better  under¬ 
stood  by  making  substitutions  in  the  equations.  If  we  l^t  p(x)  -  0.5 
then  the  logit  of  x  will  be  the  natural  logarithm  of  1,  or  zero. 

If  we  let  x  be  larger  than  u  by  one  gamma-unit  (this  is  comparable 
to  "one  sigma  above  the  mean"  in  the  normal  distribution)  we  would 
find  that 


l (x )  -  -  i. 

As  a  consequence,  p(x)/q(x)  -  exp(l)  ■  2.71928.  Hence,  p(x)  must  be 
0.73106. 

12.  A  similar  y-txis  transformation  can  be  made  to  produce  a  straight 
line  for  the  Gaussian  cumulative  function.  The  units  of  the  vertical 
coordinate  usually  have  been  designated  normlts,  with  zero  normits 
being  made  to  correspond  to  a  probability  of  0.50.  Finney,  in  his 
probit  analysis,  uses  units  of  probits  which  are  numerically  5.C 
greater  than  the  normit. 
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Slope  and  Variance 

13.  The  slope  of  the  normal  cumulative  curve  (in  the  normal  proba¬ 
bility  space)  is  l/o  where  a2  is  the  variance.  The  slope  of  the 
logistic  cumulative  curve  (in  the  logistic  probability  space)  is 
1/Y.  The  expression  for  the  variance  of  the  logistic  distribution 
is  given  by  the  following  equation 


(The  derivation  of  this  expression,  as  well  as  other  moments  of  the 
p.d.f.,  is  given  in  Appendix  B.)  Table  2  has  been  included  to  show 
the  relationships  between  the  logistic  and  two  Gaussian  straight  line 
coordinate  systems  and  their  corresponding  probabilities. 


Table  2 

Various  Y-Axis  Parameters  for  the  Gaussian  and 
Logistic  Probability  Spaces 


Oaussi 

an  Probability 

Logistic 

N 

P 

Cumulative 

L 

Cumulative 

Normit 

Probit 

Probability 

Logit 

Probability 

4 

9 

0.999683 

4 

0.982014 

3 

B 

0.998650 

3 

0.952574 

2 

7 

0.977250 

2 

0.880797 

1 

6 

0.84134 

1 

0.731059 

0 

5 

0.500000 

0.500000 

-1 

4 

0.15866 

0.268941 

-2 

3 

0.022750 

0.119203 

-3 

2 

0.001350 

0.047426 

-4 

1 

0.000317 

Hi 

0.017986 
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III.  BRUCETON  METHODS  FOR  DATA  COLLECTION  AND  ANALYSIS 


14.  The  Bruceton  plans  for  collecting  and  analyzing  data  are 
described  in  the  liter ature1 ,a  .  However,  at  least  some  of  these 
sources  may  not  be  readily  available.  We  have  decided  to  include 
an  exposition  of  the  procedures  so  that  this  report  can  be  self- 
sufficient.  Some  of  the  notation  has  been  changed  to  exploit  the 
advantages  of  the  logistic  distribution. 

Strategy 

15.  The  goal  of  the  test  method  is  to  concentrate  the  trials  at  a 
few  levels  centered  about  x,  the  stimulus  which  will  cause  50% 
response.  The  units  are  tested  one  at  a  time,  the  test  level  being 
selected  in  a  manner  which  is  most  apt  to  cause  a  response  opposite 
to  the  one  just  observed.  The  Bruceton  data  collection  plan  is 
carried  out  in  the  following  wayj 

a.  Select  a  number  of  equally  spaced  stimulus  levels  xx ,  xa, 

x,  ,  . x  where  the  lowest  and  highest  are  about 

equidistant  from  the  expected  x  (50%  response  level.)  Let  d 
represent  the  step  size  (the  difference  in  magnitude  of 
stimulus  between  any  two  adjacent  levels) . 


:£ 


( 


I 


b.  Choose  a  level  (closest  to  the  expected  50%  point)  and  test 
the  first  item  at  this  level. 


c.  Teat  all  succeeding  items,  one  at  a  time,  by  repeated 
applications  of  the  following  process j 

(1)  Note  the  level  at  which  the  last  item  was  tested  and 
note  the  behavior  of  this  item; 

(2)  If  the  item  responded,  test  the  next  one  at  the  next 
lower  level ;  or 

(3)  If  the  item  did  not  respond,  test  the  next  one  at  the 
next  higher  level. 

(4)  Record  the  result  as  a  response  or  non-response  at  the 
appropriate  level. 


i 

i  ■ 

3  ; 

t  ' 


* 


16.  Recalling  that  sti 
a  greater  probability  o 
stimulus  we  see  that  th 
the  50%  response  point, 
x,  the  probability  of  r 
that  (by  application  of 
probably  be  closer  to  x 
expected  to  cause  the  s 
ceding  test  level.  Use 
around  x  leading  to  a  z 
sequentially  on  a  tally 


mulus  is  defined  in  such  a  way  that  we  expect 
f  response  with  an  increased  (higher  level  of) 
e  above  procedure  concentrator.  the  testing  around 
If,  for  instance,  we  happen  to  be  far  above 
esponse  will  be  quite  close  to  1.0  which  means 
rule  c.{2)  the  succeeding  test  level  will 
.  Similarly,  a  trial  far  below  x  would  be 
ucceeding  level  to  be  higher  th.rn  the  pre- 
of  the  Bruceton  method  causes  a  hovering 
ig-zag  pattern  when  the  results  are  recorded 
sheet  such  as  in  Pig  5. 


.J  1 


stimulus 


i 
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NOTE:  X  SIGNIFIES  A  RESPONSE 

O  SIGNIFIESA  NON-RESPONSE 


FIG.  5  TALLY  OF  TYPICAL  RESULTS  OF  A  BRUCETON  TEST 
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Initial  Conditions  for  Bruceton  Test 

17.  Three  .  hm  ‘  ■  must  be  made  before  a  Bruceton  teat  can  be 

performed : 

a.  the  proper  dosage -stimulus  transform  (paragraph  6); 

b.  the  starting  level;  and 

c.  the  step  size. 

18.  In  order  to  use  the  Bruceton  method  for  analyzing  the  data,  the 
test  levels  must  be  set  at  equal  spacinqs  of  increasing  intensity 

of  stimulus.  Under  actual  testing  conditions  we  sometimes  find 
(particularly  when  the  step  size  is  small  compared  to  the  mean) 
that  there  is  no  practical  difference  between  linear  and  logarithmic 
steps.  In  such  a  case  no  transform  is  necessary.  In  some  casec 
logarithmic  steps  would  complicate  the  experiment,  as  for  instance, 
adjusting  the  drop  height  on  a  stab  primer  test  machine  which  has  a 
ratchet-detent  mechanism  with  stops  at  quarter-inch  intervals.  In 
such  cases,  it  should  be  possible  to  choose  a  set  of  logarithmically 
spaced  numerical  values  which  will  have  a  minimum  deviation  from 
the  experimental  levels.  This  will  introduce  an  error  which  will  have 
to  be  lived  with. 

19.  For  best  efficiency  the  starting  level  should  be  close  to  x.  Data 
obtained  previous  to  the  first  alternation  of  responses  and  non¬ 
responses  should  not  be  used  in  the  data  analysis.  For  example,  in 
Fig  5  trials  4  and  5  are  the  first  alternation  (reversal),  and,  as  a 
consequence,  trials  1,  2,  and  3  must  be  discarded.  The  early  encounter 
of  the  first  reversal  is  made  more  likely  by  starting  the  test  close 

to  the  5C%  point.  Also,  as  has  been  brought  out  in  a  previous  study*, 
a  starting  level  some  distance  away  from  the  mean  tends  to  bias  the 
estimate  of  the  mean  for  small -sample  Brucetons. 

20.  The  choice  of  d,  the  step  size,  depends  upon  what  kind  of 
Information  is  needed  and  often  entails  a  compromise.  If  a  close 
estimate  of  the  mean  is  desired  without  much  accuracy  in  the  estimate 
of  the  standard  deviation,  then  d  might  be  1/4  to  1/2  of  7  (if  a 
Gaussian  distribution  is  assumed)  or  1/2  to  1  of  v  (for  a  logistic 
distribution) .  A  better  estimate  of  the  standard  deviation  with  a 
corresponding  sacrifice  of  an  accurate  estimate  of  the  mean  would 
require  the  use  of  d  about  equal  to  2?  (or  4 V )  .  When  one  desires 
estimates  of  both  parameters  then  the  best  compromise  seems  to  be 

to  set  d  about  equal  to  a  (or  2V).  As  a  passing  note  we  caution  that 
a  single  run  of  six  or  more  steps  with  obviously  different  50%  points, 
before  and  after  the  run,  may  indicate  that  the  experiment  is  out  of 
control . 

21.  If  the  step  size  is  very  large  compared  to  the  variability 
parameter,  an  alternating  two-level  pattern  may  be  obtained.  This 
will  happen  when  one  level  is  far  below  x  and  the  next  higher  level 
is  far  above  x.  The  probability  of  observing  any  responses  at  the 
lower  level  or  any  non-responses  at  the  higher  level  is  very  small. 


-  a 


:r/  i.*m 
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On  the  other  hand,  a  three-level  pattern  may  evolve  when  the  middle 
level  ia  close  enough  to  x  that  a  mixed  response  can  be  expected,  and 
the  other  level*  are  so  far  removed  from  x  that  the  probability  of 
observing  all  responses  on  one  and  all  non-responses  on  the  other  is 
vary  large. 


22.  Zn  either  of  these  cases  (where  the  step  size_i»  large)  we  can 
deduce  that  we  have  found  the  limits  within  which  x  is  located.  We 
also  may  be  able  to  guess  at  an  upper  limit  for  the  size  of  the 
variability  parameter.  But  these  estimates  and  guesses  may  not  be 
very  informative  unless  the  size  of  the  step  is  small  enough, 
physically,  compared  to  the  desired  accuracy. 


23.  Confidence  limits  can  be  assigned  to  a  stimulus,  Xp,  associated 
with  an  expected  response  of  p  as  follows.  (A  numerical  example  is 
given  in  steps  9  and  10  of  the  first  illustrative  example,  paragraph 
26.)  The  quantities  sm  and  sq  are  calculated  in  the  first  part  of 
the  analysis  and  from  these  wl  derive  Sp  using  the  variance*  equation! 


m 


r  l* 

L  (x  )  ' 
i-  P  -> 


(9) 


Having  obtained  sp  we  can  than  write  the  lower  and  upper  confidence 
limits  for  Sp  as 


L  *  x_  -  ts„ 

p  p 

(10a) 

U  ■  x  +  ts 

P  P 

(10b) 

where  the  t  is  the  Student's  t  with  the  assumed  confidence  and  with 
the  proper  number  of  degrees  of  freedom.  For  95%  two-sided  confidence 
limits  we  should  enter  a  t  table  with  P  ■  97.5%  since  this  gives  us 
2.5%  outside  each  side  of  the  stated  limits.  The  authors  of  Reference 
1  assumed  a  very  large  sample,  therefore  they  used  t  with  an  infinite 
number  of  degrees  of  freedom.  For  small  samples  which  are  actually 
used  in  experimental  work  it  would  be  better  to  use  the  value  of  t 
with  the  number  of  degrees  of  freedom  equal  to  the  number  of  fires 
or  fails  observed  (whichever  was  used  in  the  computations).  For 
high-speed  computer  use  we  can  approximate  the  values  of  t  quite  well 
by  the  algorithm 

“  R  +  ST3J  (11) 


*b„,  s^,  and  sp  are  the  variabilities  ot  the  estimate  of  V,  of  the 
mean,  and  of  ahy  particular  per  cent  response  point  respectively. 
The  variance  equation  referred  to  can  be  found  on  page  6  of  Ref.  6. 
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where  f  is  the  number  of  degrees  of  freedom  and  the  values  of  R,  S, 
and  V  depend  upon  the  desired  value  of  P.  The  following  are  examples: 


p 

R 

S 

90 

1.202 

1.2220 

95 

1.645 

0.6602 

97.5 

1.960 

0.4210 

V 

1.1345 

0.6279 

0.4774 


The  resulting  values  agree  in  general  with  the  tabulated  values  of 
t  when  f>  6  for  P  ■  97.5;  for  f  .>  7  for  P  ■  95?  and  for  f  >.  9  for 
P  ■  90.  Table  3  gives  t  values  for  five  values  of  P  and  compares  the 
results  of  using  the  algorithm  with  published  tabular  values.  Mote 
that  the  constant  R  is  actually  t„.  we  emphasize  that  the  tabular 
values  are  the  correct  values  and  that  this  algorithm  is  an  approxi¬ 
mation  designed  for  computer  use. 

The  Bruceton  Analysis  Method 

24.  The  objective  of  any  Bruceton  experiment  is  to  obtain  x  and  g 
(the  estimates  of  the  population  parameters  u  and  Y)  and  statistical 
parameters  which  can  be  used  to  give  the  probable  error  of  these 
estimates.  Note  that  the  Greek  letters  u  and  v  are  reserved  for  the 
population  parameters  whose  values  are,  in  real  life,  not  available 
to  the  experimenter.  The  computational  procedure  is  quite  simple, 
starting  with  a  tabulation  of  the  usable  fires  and  fails  observed*  at 
the  various  test  levels,  as  an  example,  the  data  of  Pig  5  would  be 
tabulated  as  follows: 


Stimulus 

X 

Number  of  Responses 

_  nx,i  __  _  _ 

Number  of  Non 

Responses  n^  , 
o,  i 

4.00 

1 

0 

3.80 

2 

1 

3.60 

9 

2 

3.40 

7 

10 

3.20 

1 

7 

3.00 

0 

1 

rnx,i"i0 

“no,i"21 

25.  For  the  analysis  a  choice  is  made  between  responses  or  non¬ 
responses,  whichever  has  the  lesser  total  quantity.  In  the  example  the 
responses  therefore  are  chosen.  Each  test  level  is  assigned  an  index 

*ln  this  report  the  number  of  fires  at  a  particular  level  (the  i-th 
level)  will  be  represented  by  a  double  subscript:  nx  j  ?  and  the  number 
of  fulls,  similarly:  nQ  ^ .  ’ 


•  ijptvt*  ***-M*^«r.k*H  ■•*  t#  .46>, 
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TABL8  3 


ALGORITHM  FOR  COMPUTATION  OF  t  WITH  f  DEGREES  OF 
FREEDOM  FOR  SELECTED  VALUES  OF  P 


Equationi  t-R+l/(s£-V) 


P-90% 

P-95% 

P-97. 

5% _ _ 

P-99% 

P-99. 

5% 

R 

TTT5T- 

rrm 

17960 

2,326 

2.576 

8 

1.2228 

0.6602 

0.42,10 

0.26687 

0.20276 

V 

1.1345 

0.6279 

0.4774 

0.37980 

0.33618 

£ 

Calc 

Tab 

Calc 

Tib 

Calc 

Tab 

Calc 

Tab 

Calc 

Tab 

5 

1.4828 

1.476 

2.0190 

2.015 

2.5744 

2.571 

3.3736 

3.365 

4.0518 

4.032 

6 

1.4432 

1.440 

1.9450 

1.943 

2.4481 

2.447 

3.1447 

3.143 

3.7119 

3.707 

7 

1.4166 

1.415 

1.8954 

1.895 

2.364'"' 

2.365 

2.7979 

2.998 

3.4992 

3.499 

8 

1.3976 

1.397 

1.8598 

1.860 

2.3059 

2.306 

2.8958 

2.896 

3.3537 

3.355 

9 

1.3833 

1.383 

1.8331 

1.833 

2.2619 

2.262 

2.7206 

2.821 

3.2477 

3.250 

10 

1.3721 

1.3->2 

1.8123 

1.812 

2.2279 

2.228 

2.7629 

2.764 

3.1672 

3.169 

15 

1.3401 

1.341 

1.7528 

1.753 

2.1313 

2.131 

2.6020 

2.602 

2.9457 

2.947 

20 

1.3248 

1.325 

1.7245 

1.725 

2.0859 

2.08b 

2.5277 

2.528 

2.8449 

2.845 

25 

1.3159 

1.316 

1.7079 

1.700 

2.0595 

2.060 

2.4849 

2.48b 

2.7873 

2.787 

30 

1.3101 

1.310 

1.6971 

1.697 

2.0422 

2.042 

2.4571 

2.457 

2.7500 

2.750 

40 

1.3029 

1.303 

1.6837 

1.684 

2.0211 

2.021 

2.4231 

2.423 

2.7046 

2.704 

50 

1.2986 

1.298 

1.6  750 

1.676 

2.0086 

2.009 

2.403] 

2.403 

2.6780 

2.678 

60 

1.2958 

1.296 

1.6706 

1.671 

2.0003 

2.000 

2.3900 

2.390 

r .6607 

2.660 

80 

1.2923 

1.292 

1.6641 

1.664 

1.9901 

1.990 

2.3737 

2.374 

2.6390 

2.639 

,.00 

1.2902 

1.290 

1.6602 

1.660 

1.9840 

1.984 

2.3640 

2.365 

2.6262 

2.626 

200 

1.2861 

1.286 

1.6536 

1.653 

1.9719 

1.972 

2.3449 

2.343 

2.6009 

2.601 

500 

1.2836 

1.283 

1.6480 

1.648 

1.9647 

1.965 

2.3335 

2.334 

2.5859 

2.586 

I 

1.2820 

1.282 

1.6450 

1.645 

1.9600 

1.960 

2.3260 

2.326 

2.5760 

2.576 

I 


* 

* 

1 


Not*  i 


This  is  •  aingla-sfdsd  t  tabla 
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number,  1,  which  increases  in  integral  atepa  per  level  with  increaaing 
intensity  of  stimulus.  Customarily  the  zero-th  level  (i  “  0)  is 
assigned  to  the  lowest  level  at  which  tests  were  carried  out,  but  it 
can  be  put  wherever  the  experimenter  wishes.  By  setting  i  •  0  at  the 
level  at  (or  near)  which  the  largest  number  of  observations  was  made, 
the  sizes  of  the  numbers  are  reduced,  often  making  the  computations 
possible  by  inspection  or  simple  mental  arithmetic.  The  two  methods 
will  be  carried  out  side  by  side  to  facilitate  comparison,  The 
derivations  of  the  equations  and  detailed  explanations  of  such 
variables  as  M,  D,  E,  6,  0,  and  H  will  be  given  in  Part  IV  of  this 
report. 

Illustrative  Computations,  First  Example 
26.  Step  1.  Assignment  of  indices,  x0  and  d. 


d  ■  -x0 


4.00 

5  1 

4.00 

3.80 

4  2 

3.80 

3.60 

3  9 

x0"  3.60 

3.40 

2  7 

3.40 

3.20 

1  1 

3.20 

x0«  3.00 

0  0 

3.00 

Step  2. 

Computations  of  N, 

A,  and  B. 

mummn 


tWPfc&rf  ***>>  ,  Tf«YT** 
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(26.  Illustrative  Computation*,  Pirat.  Example,  Continued.) 
Step  3.  Computation  of  x,  the  stimulus  for  50%  response. 


If  *  *  *>x,i 

If  N  -  Tn  < 
o  t  * 

using  the  fires  i 

*  ■  ,t»+<i!  -  j) 

x  -  3.00+0.20(|5  - 
x  -  3.45 


(for  the  fir#*)  then  x  ■  x3+d(jj  - 
(for  the  fails)  then  x  ■  *e+d(jjj  ♦ 

s  -  x0t<§  -  \) 

x  -  3.60+0.20(-  -  £ 

x  -  3.45 


(13a) 

(13b) 


Note  that  x  is  the  aame  for  both  Bats 
of  indices . 


Step  4.  Computation  of  M. 


S  - 1'$''’ 

I  vTJ  y 

M  -  B 

M  s  -  \as 

(14) 

167  /55'\S 

"KT  “  V.27Jy 

M  -  17  C  5"# 

M  70  - 

8.35  -  7.5625 

M  -  0.85  -  0.0625 

0.7875 

M  -  0.7875 

Not*  again  that  the  difference  in  indie**  did 
not  cha  7*  the  final  answer. 
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(26.  Illustrative  Computations,  First  Example,  Continued.) 


Step  5.  Determination  of  D. 


(15) 


where  x*  is  the  teat  level  cloaeat  to  x. 


D  -  J*l*2=L**i . -  -  0.25  . 

0.20 

The  value  of  D  will  have  the  limits  0.0  <.  D  <.  0.5  and 
will  not  be  needed  if  M  is  greater  than  0.65,  which  is 
the  case  in  the  present  example. 


Step  6.  Determination  of  E. 


E  *  M,  for  the  limits  of  0.65  <  M  <  10,  (16a) 

E  -  M  +  6,  when  M  <  0.65  .  (16b) 

The  correction  term  6  is  a  function  of  both  M  and  D 
and  can  be  found  either  from  rig  A-2  or  in  Table  A-l . 

For  M  greater  than  10  the  value  of  E  begins  again  to 
depend  upon  both  M  and  D.  However,  when  M  approaches 
10  it  is  known  that  a  much  too  small  step  size  is 
being  used.  Since  the  results  of  such  a  test  are 
apt  to  be  very  misleading  we  have  stopped  the  tables 
at  this  point. 
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.  Illustrative  Computations,  First  Example,  Continued.) 
Step  7.  Computation  of  g,  sm,  and  a^. 


E«d  , 

(17) 

(a.g)//1T,  and 

(18) 

(H.g)//S  , 

(19) 

where  0  and  H  are  functions  of  E  alone,  when  E  >  0.65. 
When  E  <  0.65,  G  and  H  are  functions  of  both  E  and  0. 
The  values  of  G  and  H  are  given  in  Tables  A-2  and  A-3 
and  plotted  in  Figures  A-3  and  A-4  in  Appendix  A. 


For  the  numerical  example: 

g  -  (0.7875)  (0.2)  -  0.1575 

sm  -  (1.630) (0.l575)/(4. 472)  -  0.05741 

■  -  (1  .626)  (0.1575)/(4.472)  -  0.05726  . 

9 


Step  8.  Computation  of  stimulus,  xp,  at  a  specified 
probability,  p. 

Eq.  (5),  L(x)  -  Jtn^£|£y^  -  Zyl  can  be  rewritten  in 
terms  of  p  and  the  estimates  of  the  population  parameters 
and  solved  for  xp ; 

,  v  x  -x 

Ir/rV  -  -V  <20> 

l-ps  g 

xp  *  *  +  g*inrr?p}  “  *  +  ^’L(x)  •  (21) 

For  example,  suppose  we  wish  to  estimate  the  99%  point: 

s  9Q\ 

x  -  3.45  +  0.1575^ In 
P  1  > 

-  3.45  +  0.1575(4.5951) 

-  4.174  . 

Note  that  L  (x  )  *  4.5951  . 

P 
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(26 


Illustrative  Computations,  First  Example,  Continued.) 


Step  9. 


Computation  of  a  . 

r 


The  variance  associated  with  the  estimated  stimulus,  x_, 
is  given  by  applying  Eq.  ( 9 ) t  ■ 


s 


3 

P 


r  . 

it  *P  J 


The  term,  L(x-),  has  been  evaluated  in  Step  8.  The 
standard  deviations  of  the  moan  and  of  g  have  been 
determined  in  Step  7.  (Note  that  when  p  ■  0.50, 

L (Xp)  ■  0  and  s0,i0  properly  roducea  to  s™  , )  Follow¬ 
ing  along  with  the  illustration  we  find  that 


sp  -  /W. BS’Uiy* '"+ . r4".T5TIl*T5.357 257r  -  0.2693. 


Step  10.  Two-sided  confidence  interval  about  x  . 

P 

If,  for  instance,  we  wiah  to  find  the  two-sided  95% 
confidence  interval  about  the  99%  point  we  would  use 

(L,U)*b  ■  (Xp  -  ta  Sp,  Xp  +  t»  7ti)  Cp)  (10) 

where  Xp  ia  the  99%  point  and  t  ia  the  97.5%  Student's 
value,  with  f  degrees  of  freedom  where  f"N*20.  The 
value  of  t  (from  Table  3)  is  2.0859;  and  xp,  from 
Step  8  above,  ia  4.174.  Hence, 

L,b  •  4.174  -  (2.086) (0.2693)  -  3.61 
U9B  ■  4.174  ■»  (2.086)  (0.2693)  -  4.74  . 


Step  11.  Single -sided  limit  on  xp . 

If,  instead  of  an  error  band  or  tolerance  interval 
about  x  ,  we  wish  to  find  only  an  upper  limit  (or  only 
a  lowerplimit)  for  the  estimate  of  a  particular  response 
level  we  would  use  either 
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(0)i.  “  xp  +  t«8sp,  or 


(L)t  t  “  xp  “  t»  «*p  • 


Thus  for  the  example  w*  would  uss  s  vslus  of  t 
(with  20  degrees  of  freedom  sine*  N  ■  20)  of 
1.725  which  would  give 


(U)t|  -  4.174  +  (1.725)  (0.2693) 
-  4.64 


Motion  that  the  single-aided  uppsr  95%  limit  —  4.64  - 
closer  to  ths  value  of  xp —  4.174  —  than  tha  upper 
two-aided  95%  limit  —  4.74.  This  is  as  it  should  be. 


Illustrative  Computations,  Second  Example 

27.  A  second  example  i*  included  to  show  the  procedure  when  M 
to  come  out  less  than  0.65,  The  data  are  shown  in  Fig  6. 


Step  1.  Assignment  of  indices,  x0  and  d. 


3.80 
3.60 
x0-  3.40 
3.20 


2 

1 

0 

-1 


no,l 

0 

2 

13 

1 


Note:  Use  "fails"  since 
are  fewer  "fails"  than 
x0  -  3 .40 »  d  -  0.20. 


Step  2.  Computation  of  N,  A,  and  B. 


2 

1 

0 

-1 


2^ i 
0 
2 
13 
1 

ff=TT 


in 


Sul 


0 

2 

0 

-1 


i*  n 


Sul 


0 

2 

0 

+1 

IF^T 


20 


(22a) 

(22b) 


is 

happens 

there 

"fires". 


STIMULUS  STIMULUS 
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FIG.  6  TALLY  SHEET  FOR  SECOND  BRUCETON  EXAMPLE 
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(27.  Illustrative  Computations,  Second  example,  Continued.) 

Step  3.  Computation  of  x. 

x  -  x3  +  +  j)  (13b) 

-  3.40  ♦  0.2^  4  J) 

-  3.5125. 


Step  4.  Computation  of  M. 

u  _  B  /A>a  _  BM-Aa 

M  a  ■  vijy  -  -p- 

_  (3) (16) -1 

"  TTSTTrn 

-  0.1836. 


Step  5.  Determination  of  D. 


D  « 


I  x '  -x  I 


3.60-3.51251 

0.2 


-  0.4275. 


(14) 


Step  6.  Determination  of  E 


E  -  M  +  6 


Prom  the  graph,  Pig  a-2,  or  by  double  interpolation 
from  Table  A-l,  we  find  that  6*0.0409  and  E*0.225. 
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(27.  Illustrative  Computations,  Second  Example,  Continued.) 


Tabular  6  Values 


\m 

D 

0.1800 

0 .1850 

0.4000 

0.5000 

0.0399 

0.0456 

0.03B4 

0.0440 

_ 

we  show  the  actual  process  of  interpolation! 


\  M 

D  X. 

0.1800 

0.1836 

0.1850 

0.4000 

0.0580 

0.0388* 

0.0384 

0.4325 

0.0409** 

0.5000 

0.0456 

0.0444* 

0.0440 

•Pirst  interpolation 

♦•Second 

Interpolation 

Step  7.  Computation  of  g,  sm,  sg. 


g  -  E -d  (17) 

■  (0.225)  (°*2) 

-  0.0450 

Prom  the  graph,  Pig  A-3,  or  by  double  interpolation 
from  Table  A-2,  we  find  that  G  ■  2.4930. 
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Illustrative  Computations,  Second  Example,  Continued.) 

Tabular  o  Values 


0.2000 

0.2500 

0.4000 

0.5000 

2.666 

2.769 

2.265 

2.306 

(2.4  9  3  0)  (0.0  4  50) 

*m  "  a . -■ 

16 

-  0.028 

Similarly  from  Figure  A-4  or  Table  A~3,  H  ■  1.146: 

Tabular  H  Values 


0.4000 

0.5000 


0.2000 

0.2500 

1.141 

1.105 

1.174 

1.140 

1.1458  0.0449 


»  0.0129 


•¥ 


KOI  T1?  73-91 

(27.  Illuatrati\»a  Computational  sacond  Bcampla,  contlnuad.) 

Strp  8.  Computation  of  xp. 

Taka  p,  lat  ua  aay,  aa  0.95  (tha  95%  point) t 

xp  -  *  +  g.in(r?5J)  (21) 

-  3.5125  +  0.0449  (In  19) 

•  3.6447  . 

Stop  9.  Computation  of  ap. 

•?  ’  •/‘•m1’  +  [lnCl?pj]  'V* 

•■fit.  0280)*  ♦  (2.944)*  (0.0129)*  j 

•  0.0472  . 
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(27.  Illustrative  Computations,  second  Example,  Continuad.) 


Ste  10.  Two-aided  confidence  interval  about  the  95%  point. 
Take  the  confidence  level  to  be  90%.  The  student 'a  t  value 
will  be  at  a  95%  level  for  f  -  N  -  16 


*’*  *  * 1<645  +  troswvflgi "tot? 

-  1.7457 

L  -  3.5125  -(1.7457) (0.0472) 

>o 

-  3.43 

U  ■  3.5125  +  (1.7457)  (0.0472) 

•  e 

-  3.60 

Step  11.  Single-aided  lower  limit  on  the  95%  point  at 
90%  confidence 

We  find  that i 

t  •  1.232  +  - i - 

(1.2228)  (16)  -  1.1345 

-  1.3363 

The  lower  limit,  then  iai 

L  «  3.5125  -(! .3363)  (0.0472) 


(ID 


-  3.45 


■ww,i-si»gwi.'iri .  IB ■  nggwt  P.f WggCT 
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IV.  THEORETICAL  STUDIES  FOR  THE  LARGE  SAMPLE  LOGIT  BRUCETON 

28.  In  Section  ill  procedures,  tables,  and  graph*  were  given  to 
estimate  the  atatistical  parameters  R,  g,  sm,  and  Bq  from  Bruceton 
data  on  the  assumption  of  a  logistically  distributed  population. 

The  tabular  (and  graphed)  values  of  6,  G,  and  H  are  asymptotic 
values;  that  is,  they  were  computed  using  large-sample  statistical 
theory  and  taking  into  account  the  properties  of  the  Bruceton 
data  collection  method.  The  approach  is  patterned  after  the 
original  work  done  by  the  Applied  Mathematics  Panel  assuming  the 
Gaussian  distribution  (references  1  and  2) . 

29.  The  computations  of  the  50*  point  should  be  the  same  for  either 
distribution,  since  the  assumption  that  the  distributions  are 
symmetrical  about  the  mean  is  valid  for  both.  Consequently,  the 
Bruceton  estimate  of  the  mean  is; 


r  Sinx,l 


(23a) 


(23b) 


These  are  equivalent  to  equations  l 3a  and  b  of  the  previous 
section; 


*  ’  <„  *0  'll-  -  t)' 


(for  the  fires),  or 


R  -  X0  +  d  (for  the  fails)  . 


(13a) 


(13b) 


30.  The  intermediate  parameter,  M,  for  estimating  variability 
parameters  was  defined  in  the  same  way  for  tlio  logistic  Bruceton  as 
for  the  Gaussian; 

'j.niYri2ni)  -  (rm^2 

M  -  iy.:>  ..*■< - i - -  (24) 


Where,  in  the  asymptotic  cast,  either  nx  ^  or  Q  can  be  u*ed 
for  n  ' 


a  r 


Vf*“* 


, .... . 

a 


-  •  »  V 


i 


r, 
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This  Is  equivalent  to  equation  14  in  the  previous  asotlon. 


M 


NB  -  A  * 

“V - 


(14) 


Th«  valus  of  g  (ths  estimate  of  V )  would  bs  found  by  applying 
squation  16  followed  by  equation  17 i 


E  ■  M  +  6 


U6) 


where  6  ■  0  when  0.65  <M<10;  and 


g  ■  E*d. 


(17) 


31.  The  variance  of  x,  (V-),  and  g,  (v  ) ,  can  be  estimated 

using  the  method  of  maximum  likelihood* .  The  likelihood  function  is 


P 


X  a 

n  p.  n  qi 

i  1  i 


(25) 


and  ita  logarithm  N  N 

x  o 

L  *  I  In  +  L  1^  ^  (26) 


where  N  is  the  number  of  responaea  at  all  levels,  and  N  is  the 
x  o 

number  of  non-responses  at  all  levels.  Maximum  likelihood  theory 
gives  the  asymptotic  variance  of  £  and  g  as 


(27) 


28 
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The  symbol  e 
derivatives* 
to  give 


(28) 


is  used  to  indicate  the  expected  values  of  the 

The  expected  values  for  these  derivatives  can  be  evaluated 


x 


Va 

rpK 


rpl,lyl 


and 


where  y.  is  defined  as 

Xj-U 

■  y-  and 


(29) 

(30) 


where  the  summation  is  over  all  trials  at  a  level  as  well  as  over 
all  levels  of  the  Bruceton  test.  Since  for  the  usual  Bruceton 
notation  the  summation  over  i  means  a  summation  only  over  the  levels , 
the  above  equations  must  be  rewritten  for  consistency;  doing  this 
and  solving  for  the  standard  deviation  gives 


m 


-  ss  -  7^  -  / 


and 


A r  - 


E(nx,i  + 

y  _______ 


9  9  ^(^i  +  no,i,piVi  * 


where 


(31) 


(32) 


s  ahd  s-  are  used  interchangeably, 
m  x 

As  with  the  case  in  which  the  normal  distribution  is  assumed,  wa 
should  be  able  to  express  the  values  of  sm  and  s^  ab 


*m  VlT  ’  ,ni 

(33) 

.  • 

(34) 

v 

Here  N  is  the  smaller  of  the  two  values  N  and  N  ,  but  in  the 
asymptotic  case  “  N0,  so  that  either  one  can  Be  used.  Solving 


'cv 
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(31)  and  (33)  for  a,  and  solving  (32)  and  (34)  for  H,  gives 


G 


/ - B  — 

^t(n1  +  mi)piqi  ' 


and 


(35) 


H 


£ 


i r 


(36) 


The  parameters  o  and  H  would  then  be  used  in  equations  18  and  19  to 

compute  s  and  s  i 
m  g 


(0*g)//IT 

and 

(18) 

<H’g)//tr  . 

(19) 

32.  we  derived  numerical  values  for  the  correction  terms  6,  a,  and  H 
by  generating  expected  very-large-sample  Bruceton  results  for  variots 
combinations  of  step  sise  and  spacinga  of  the  mean  from  the  closest 
test  level.  By  expressing  the  step  size  ir.  units  of  the  population 
V.  and  the  spacing  of  the  mean  in  units  of  step  size,  we  generated 
dimensionless  variables  which  are  independent  of  the  actual  distribu¬ 
tion  t*  end  Prom  the  expected  Bruceton  results  for  each  combina¬ 
tion  of  step  size  and  mean  spacinga  6.  o,  and  H  were  computed  Using 
equations  15.  17,  24,  35  and  36. 

33.  Arbitrarily  we  chose  »  to  be  1000  and  y  to  be  10.  We  then 
chose  step  sizes  ranging  from  d  -  O.lv  to  d  ■  10>.  For  each  of  these 
center  levels  we  then  set  up  an  array  of  levels  (spaced  d  units 
apart)  above  and  below  the  center  levol  and  including  the  center  level. 
For  each  of  the  levels  in  the  array  we  then  computed  the  logit  value, 

of y^,  associated  with  Xi  by 


*1 


XA  -  1000 
10 


The  expected  and  q^  for  each  level  was  computed  from  y<  by  equa¬ 
tion  5.  We  then  chose  arbitrarily  a  level  several  steps  below 
the  mean.  At  this  bottom  level,  xi#  we  stipulated  that  there  would 
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b«  on*  tri*i  which  would  b*  a  fail.*  (A*  will  b«  a**nr  this  l*v*l 
must  b*  chosen  far  enough  below  the  mean  that  the  probability  of  file 
is  quit*  small.)  The  expected  number  of  fire*  at  the  next  higher 
level  is  equal  to  the  number  of  fails  at  the  previous  level.* v 
That  is,  for  all  levels  we  can  say  that 

nx, (i  +  1)  "  no,i  *  ^37) 


At  any  leval  above  the  lowest  the  expected  number  of  fails  will 
depend  on  the  probability  of  firing  at  the  level  and  the  expected 
number  of  fires  as  generated  by  aquation  (37) .  The  expected  number 
of  fails  is 


no,U  +  1) 


nx,(i  +  i)  q(i  »  i) 
p(i  ♦  i) 


(38) 


in  our  work  n0  was  rounded  off  tr  the  nearest  whole  number.  If  the 
Bruceton  test  size  was  less  than  100,000,000  the  process  was  repeated 
starting  at  lower  levels.  Also  the  process  was  iterated  similarly 
until  successive  values  of  6,  a,  and  H  showed  no  chanqes  in  the 
first  four  significant  figures. 

34.  A  specific  computation  is  included  to  show  the  process: 


We  remember  that  »  -  1000  and  y  -  10. 

W*  wish  to  generate  the  values  for  the  case  wt«n  the  step 
size  is  40,  that  is,  when  y/d  ■  0.4;  and  when  the  central 
level  (the  level  closest  to  the  mean)  is  0.4  of  a  step 
away  from  t* .  The  central  level  is  therefore,  1016. 

We  assign  i  «  0  to  the  central  level  and  then  set  up  an 
un^  of  levels  and  indices  below  and  above  x.  The  levels 
are  40  units  apart:  896,  936,  976,  1016,  1056,  1096; 
the  corresponding  indices  are  -3,  -2,  -1,  0,  +1,  +2. 


*We  could  have  started  with  two  or  more  fails  (and  no  fires)  at  the 
bottom  level  without  changing  the  results  provided  the  proba¬ 
bility  was  small  enough. 

**There  are  certain  properties  of  the  Bruceton  data  collection  plan 
which  can  be  seen  by  inspection.  First  we  define  a  closed  Bruceton 
test  as  one  in  which  the  test  at  the  last  level  would  lead  to  the 
same  level  as  the  one  at  which  the  test  began.  For  any  closed 
Bruceton  test  the  total  number  of  fires  is  equal  to  the  total 
number  of  fails;  also,  the  number  of  fails  at  any  level  is  equal 
to  the  number  of  fires  at  the  next  higher  level.  Zf  the  test  is 
not  closed,  the  number  of  fails  at  one  level  will  differ  from  the 
number  of  fires  at  the  next  higher  level  by  no  more  than  1.  However, 
with  a  large  number  of  trials  at  all  levels  except  the  top  and 
bottom  an  assumption  of  equality  will  introduce  negligible  error. 


n 
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At  •ach  level,  x^,  the  values  of  y^,  and  ara  computed. 

Uaing  tha  algorithm  of  aquations  37  and  38  and  starting  at 
i  ■  -3  tha  valuaa  of  n  ,  and  n  ,  ara  computad  at  each 

1  o  i  X 

level,  yielding  the  raaulta  given  in  Table  4. 

Tha  various  summations  overall  levels  are  computed i 

S>x.i’  2>nx,i’  £l*nx,l'  Bnx,i  +  no,i^A’ 

2<nX,i  + 

The  valuaa  of  M,  G,  and  H  ara  computed  uaing  equations 
24,35,  and  36. 

Whan  the  lowest  level  is  sat  at  856  rathar  than  896  an  eight- 
level  pattern  is  generated.  The  values  of  the  summations  and  M, 

G,  and  H  for  this  latter  case  are  also  shown  in  Table  4.  There 
are  differences  between  the  six-level  and  eight-level  results,  the 
greatest  difference  being  leas  than  0,05%.  Since  the  eight- 
level  pattern  results  were  the  same  as  larger-level  patterns  they 
can  be  used  as  the  asymptotic  values. 

35.  The  process  described  above  was  carried  out  for  values  of 
v/d  ranging  from  0.1  to  10.0.  £van  though  the  algorithm  would 
work  outside  of  the  above  range  we  elected  not  to  go  further 
because  we  see  no  practical  use  for  the  results.  In  fact,  either 
with  such  extremely  large  steps  (y/d<0.1)  or  with  extremely  small 
steps  (v/d  >10.0)  a  Bruceton  test  would  be  of  dubious  value. 

For  value*  of  v/d  from  0.65  to  10.0,  M  waa  equal  to  y/d  to  aix 
significant  figures  and  independent  of  D  (the  spacing  between  the 
central  level  and  ^)  .  For  v/d  running  from  0.1  to  0.60#  cal¬ 
culations  were  made  for  values  of  D  of  0.0,  0.1,  0.2,  0.3, 

0.4,  and  0.5.  u  .rar'  H  similarly  dependent  uprn  D  for  v/d  b«?lcw 

approximately  0.65  and  otherwise  independent  of  D.  Tha  asymptotic 
values  of  M,  G,  and  H  are  plotted  in  Figures  and  g. 

36.  These  graphs  should  not  be  used  to  find  values  for  use  in 
Bruceton  computations,  because  they  have  been  made  to  show  the 
complete  range  of  valuee  and  to  show  the  shapes  of  ths  functions. 
Detailed  plota  can  be  found  in  Appendix  A.  There  are  some  other 
differences  between  the  two  sets  of  graphs.  Ths  asymptotic 
graphs  (Figures  7,  ",  and  9)  are  of  the  various  parameters 
versus  v/d.  But  of  course  in  an  actual  Bruceton  test  we  cannot 
know  vj  we  can  compute  x  from  equation  13,  M  from  equation  14, 
and  D  from  equation  15.  The  variable  E  has  been  defined  aa 

the  ratio  of  the  expected  value  of  g  to  the  step  size,  d  (equation  17). 
When  M  is  lsss  than  0.65  it  will  be  a  function  of  both  E  and 
D  as  can  be  seen  from  the  following  typical  values: 
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TABLE  4  TYPICAL  CALCULATIONS  OF  ASYMPTOTIC  VALUCS  FOR  M,  G,  &  H 


i 

Xi 

yi 

Pi 

nx,i 

no,i 

2 

1096 

9.6 

0.999932 

mrm 

0 

1 

1056 

5.6 

0.996316 

5 

0 

1016 

1.6 

0.832018 

1339 

-1 

976 

-2.4 

0.0831727 

602 

6634 

-2 

936 

-6.4 

0.0016588 

1 

602 

-3 

896 

-10.4 

0.0000304316 

0 

1 

■ix  lavala 


•ight  lavala* 


Enx<i  -  8,581 
ElnXil  -  745 

El'Vl  "  1,965 

2>x,l  +  •  1,672,05 

2>x,i  *  ’  6,226,62 


281,984,179 

24,496,639 

64,572,203 

54,946,457 

204,614,821 


M  -  0.221456 
G  -  2.265092 
H  -  1.173932 


0.221455 

2.265388 

1.173439 


*Saa  wxplainatlon  in  lattar  part  of  paragraph  34 
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FIG.  8  G  FOR  LOGISTIC  SRUCETON 
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0.250 
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o 

• 

o 

O 

0.2806 

0.2860 

0.2919 

0.10 

0.2724 

0.2789 

0.285^ 

0.20 

0.2605 
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0.30 

0.2271 

0.2386 

0.2500 

0.40 

0.2080 

0.2214 

0.2346 

0.50 

0.2150 

0. 2269 

However  during  an  ordinary  Brucaton  data  analyaia  it  ia  nacaasary 
to  dariva  E  from  tha  valua  of  M  obtained  from  aquation  (14) .  By 
a  four-term  Lagrangian  interpolation  tha  number  a  can  ha 
reorganized  into  a  table  of  E  valueas 


0,200 

0.220 

0.240 

0.260 

0.280 

- 

mBmm 

0.2588 

0.2265 


0.30 

0.2170 

0.2339 

0.40 

0,2342 

0.2489 

0.50 

0.2394 

0.2536 

0.2642 


0.2682 


0.2689 


0.2799 


0.2834 


0.2962 


0.2991 


We  found  that  a  better  graphical  presentation  could  be  made  by  plotting 
6  -  f(M,D)  rather  than  E  -  f(M,D)  where  E  -  M  +  5.  The  values  of 
6  which  correspond  to  tha  E  values  above  are: 


0.30 


-0,027 


-0.020 


0.10 


0.20 


0.30 


0.40 


0.50 


The  tabular  and  graphic  values  of  G  and  H  are  given  as  functions 
of  E  and  D  rather  than  of  M  and  D  because,  once  E  is  found,  it  is 
the  best  available  estimate  of  \/d  and  should  be  used  as  such. 

V.  MONTE  CARLO  STUDIES 


0.200  0.220 

0.240  0.260 

0.280 

- 

-0.0710 

-0.0212 

-0.0963  -0.0848 

-0.0613  -0.0411 

-0.0283 

-0.0190  -0.0164 

-0.0135  -0.0106 

-0.0082 

+0.0170  +0.0139 

1 

+0.0112  +0.00891 

+0.0071 

+0.0342  +0.0289 

\  1 
4-0,0242  *-0.0199 

+0.0162 

+0.0394  +0.0336 

+0.0282  +0.0234 

+0.0191 

37.  In  order  to  check  the  results  of  the  theoretical  work  a  Monte 
Carlo  investigation  was  carried  out.  A  program  for  the  IBM  7090 
computer  was  prepared  to  generate  random  numbers  with  a  logistic 
distribution  to  represent  the  sensitivities  or  critical  levels  of 
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tht  test  items.  The  distribution  parameters,  P  and  y,  and  tha 
sample  size,  Na,  were  adjustable.  A  run  of  one  hundred  Bruceton 
tests  was  mads  for  each  combination  of  the  quantities  investigated. 
The  sample  mean,  mB,  and  the  variability,  ga,  were  computed  for 
each  test.  The  starting  level  was  fixed  at  20.0  and  the  step 
size  at  1.0.  For  each  Bruceton  tear,  the  estimates  and  M  as 
defined  in  the  previous  section,  equations  23  and  24,  were  obtained. 
(Subscript  B  indicates  an  estimate  obtained  from  a  Bruceton  test 
and  subscript  s  refers  to  •»  value  for  the  sample.)  For  each  run 
the  average  and  standard  deviation  of  each  of  the  quantities  m_ 
and  M  was  found.  B 

38.  We  showed  in  the  previous  section  that  g/d  can  be  taken  as  equal 
to  M  if  M  >  0/65.  For  this  computer  study  (and  for  that  matter  in 
ordinary  testing),  y/d  can  be  taken  as  equal  to  M  if  m  >  0.4.  It  was 
convenient  to  use  this  relationship  for  tha  Monte  Carlo  studies. 

Since  the  step  size,  d,  was  chosen  as  unity  we  can  therefore  take 

M,  in  this  range,  as  equal  to  gB,  the  Bruceton  estimate  of  ga. 

In  this  case,  then,  the  average  and  standard  deviation  of  M  will 
be  the  average  and  standard  deviation  of  yB.  The  computation  of 
g#  when  y/d  <  0.4  depends  upon  the  relative  position  of  the  mean 
and  the  nearest  step  level.  For  each  run  we  knew  this  for  the 
population  mean.  If  the  sample  mean  were  the  same  as  the  population 
mean  we  could  use  the  curves  of  figure  7  to  estimate  yB  from  the 
value  of  M.  Inspection  of  the  curves  of  figure  7  shows  that  the 
relative  position  of  the  mean  is  not  as  critical  when  the  mean 
is  midway  between  step  levels  as  when  it  is  on  a  step  level.  For 
the  runs  in  which  the  population  mean  was  midway  between  step 
levels  the  values  of  the  mean  and  standard  deviation  of  gB  were 
estimated  from  the  mean  and  standard  deviation  of  M  by  using  the 
curve  of  figure  7  for  the  case  with  this  position  of  the  mean. 

The  values  of  the  mean  and  standard  deviation  of  gB  given  in  the 
tables  of  Appendix  C  for  y/d  less  than  0.4  were  obtained  in  this 
way.  Since  d  ■  1,  the  value  of  y/d  is  to  be  found  in  the  second 
column,  headed  by  y.  These  values  of  gB  are  too  large  and  their 
standard  deviations  are  too  small  since  the  means  of  the  individual 
tests  do  not  fall  midway  between  the  step  levels,  (This  can  be 
seen  by  comparing  the  results  which  would  be  obtained  from  the 
curve  for  m  -  h  »  0,3  with  the  results  obtained  from  the  assumption 
that  the  mean  is  midway  between  levels.)  We  did  not  estimate 
the  mean  and  standard  deviation  of  gB  for  tests  with  y/d  less 
than  0.4  and  with  the  population  mean  on  a  step  level. 

39.  For  each  run  of  100  trials  the  average  and  standard  deviation 
of  the  observed  m^  and  g_  were  calculated.  Eut  the  standard 
deviation  of  mB  is  the  observed  s„,  and  similarly  the  standard 
deviation  of  gn  is  s„.  Substituting  sm  and  s„  into  equations  33 
and  34,  using  the  average  gB  for  y  and  setting  N  (the  number  of 
fires  or  fails)  equal  to  one  half  of  Ns  permits  us  to  find  values 
of  G  and  H  which  are  representative  of  the  experimental  conditions. 
This  is  because  the  experiments  must  use  observed  values  since 

we  cannot  knov  the  population  parameters. 
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40.  Since  theoretical  development  in  the  previous  section  assumes 
large  samples  the  first  interest  in  the  Monte  Carlo  investigation 
was  the  affect  of  sample  size  on  these  results.  Runs  were 
therefore  made  with  samples  as  small  as  ten  and  as  large  as 
five  hundred.  It  is  not  difficult  to  see  that  for  small  samples 
a  few  unexpected  results  in  the  early  part  of  the  test  could 
influence  the  estimates  of  the  mean  and  the  dispersion  unduly. 

This  would  be  especially  the  case  if  the  step  were  small  or* 
in  other  words,  if  the  value  of  gamma  were  large  in  comparison 
with  the  step  size.  In  our  program  the  step  size  was  always  one. 
The  effect  of  the  relation  of  step  size  to  the  value  of  gamma  was 
investigated  by  using  population  values  of  gamma  from  0.1  to  100. 
(d/\  from  10  to  0.01)  The  effect  of  choice  of  starting  level  was 
investigated  by  using  population  means  of  19.5,  20.0,  20.5,  and 
25.0.  Since  the  starting  level  was  always  at  20.0  these  gave 
tests  in  which  the  starting  level  was  one  half-step  above,  on, 
one  half-step  below,  or  five  steps  below  the  mean.  The  results 
obtained  are  summarized  in  the  tables  of  Appendix  C. 

Bias  in  the  Estimate  of  Gamma 


41.  Other  Monte  Carlo  investigations  have  shown  that  the  Bruceton 
test,  based  upon  the  assumption  of  a  normal  distribution,  gives 

a  biased  estimate  of  the  standard  deviation  (references  7,  B) . 

It  is  evident  from  our  results  that  a  similar  bias  exists  in  the 
estimate  of  gamma  for  the  logistic  distribution.  The  amount  of 
thic  bias  is  shown  in  the  last  column  of  tables  Cl  to  C20  as  the 
ratio  of  gB  to  gB .  Tables  5  and  6  are  condensations  of  these 
results.  We  observe  that:  the  bias  decreases  as  the  sample  Bize 
is  increased;  the  bias  is  greater  as  the  ratio  \/d  increases, 
that  is,  as  the  step  becomes  small  with  respect  to  the  value  of 
gamma.  Our  results  do  not  show  a  bias  when  NB  ■  20  with  starting 
lt^el  at  the  mean  and  the  ratio  \/d  equal  to  or  greater  than  one 
(medium  or  small  step  size)  .  This  should  not  be  taken  as  a  recom¬ 
mendation  for  a  test  plan  since  uncertainty  in  the  knowledge 
of  the  value  of  the  mean  would  make  it  impossible  to  plan 
a  test  so  that  the  mean  would  be  on  a  test  level.  It  is  a 
temptation  to  use  the  bias  ratio,  g8/gB,  as  a  fudge  factor  to 
try  to  improve  the  estimate  of  \.  We  counsel  strongly  against 
such  a  measure  because  the  individual  g^  values  are  scattered 
so  greatly  about  their  average. 

Effect  of  Sample  Size  on  Estimates  of  g  and  H 

42.  The  values  of  G  and  H  as  obtained  from  the  Monte  Carlo 
investigations  agree  well  with  the  values  predicted  by  the 
theoretical  computations  when  the  sample  size  was  large  (five 
hundred  items)  and  the  step  size  was  not  extremely  large  or 
small.  The  computation  of  the  values  of  G  and  H  was  based  upon 
tho  values  of  gamma  obtained  by  the  Bruceton  analysis.  For 
samples  of  less  than  five  hundred  the  Monte  Carlo  values  of 

G  and  H  were  greater  than  the  theoretical  values.  Part,  but 
not  all,  of  this  variation  is  due  to  the  fact  that  the  value  of 
gamma  ia  underest ima ted  for  these  smaller  samples.  The  Monte 
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Table  5  Bias  in  Estimate  of  Gamma 


0.5 

1.2015 

1.1954 

1.1099 

1.0828 

1.0881 

1.0255 

1.0402 

1.0914 

1.0476 

0.9988 

0.9920 

0,9914 


1.0 

1 , 3300 
0.9992 
1,4242 
1.1754 
1.1185 
1.1252 
1.0533 
1.0634 
1.0667 
0.9871 
1.0252 
1,0198 


2.0 

1.7119 

0.9965 

1,6175 

1.2577 

1.2921 

1.2274 

1.1411 

1.1860 

1.1071 

1.0068 

1.0498 

1.0302 


3.0 

1.9870 

1,0026 

1.9508 

1.3794 

1.4253 

1.3780 

1.1933 

1.2209 

1.1979 

1.0330 

1.0367 

1.0406 


Table  6  Bias  in  Estimate  of  Gamma 
for  Sample  Size  of  Twenty 


V75T 

1*T§75 

‘4  ■'20.0 

4*20.5 

U-25.C 

m 

• 

o 

1.2015 

1 .1954 

T.l09$ 

l.lJ$3 

0.7 

1.2915 

1.2603 

1.2267 

1.1286 

0.85 

1.3939 

1.2124 

1.1624 

1.1323 

1.0 

1.3300 

0.9992 

1.4242 

1.0026 

1.5 

1.7225 

0.9982 

1.6289 

1.0ll< 

2.0 

1.7119 

0.9965 

1,5175 

1.0211 

2.5 

2.0594 

0.9989 

2.0226 

1.1251 

3.0 

1.9870 

1.0026 

1.9508 

1.4551 

4,0 

2.4999 

1.0050 

2.5306 

1.3526 

Upper  figure 

U  -  19.5 
u  -  20.0 
U  -  20.5 
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Carlo  investigations  indicate  that  values  of  sm  and  Dq  will  be 
seriously  underestimated  when  the  formulae  based  on  the  assumption 
of  large  samples  are  used  with  smaller  samples. 

43.  As  an  examp] a  of  this  underestimation  take  the  resulte  fox  a 
•ample  size  of  50  with  the  population  mean  at  20,5,  population  gamma 
at  1,  as  given  in  Table  C-ll.  In  this  case  the  average  estimate  of 
gamma  obtained  from  the  one  hundred  testa  was  0.89.  From  Tables  X-2 
and  A-3,  we  would  then  get  1.585  und  1,745  aa  values  of  G  and  H  for 
this  value  of  gamma.  Using  equations  (18)  and  (19)  with  N  ■  25  (half 
of  the  sample),  we  would  obtain  am  ■  0.282  and  s,~  -  0.311.  Table  C-ll 
gives  sm  ■  0,274  and  sg  ■  0.346  so  that  we  have  reasonable  agreement 
for  sm,  but  the  value  of  Sg  as  obtained  from  uae  of  Table  A-3  is 

too  small. 

44.  Tables  7  ana  8  give  the  effect  of  sample  size  on  the  values 
of  Q  and  H  as  computed  from  the  Monte  Ca^rlo  investigations.  The 
theoretical  values  are  given  under  the  infinite  sample  size  entry. 

Since  there  ia  no  reason  to  expect  the  values  of  G  and  H  to  be  affected 
by  the  position  of  the  mean  when  the  ratio  Y/d  is  greater  than  C.4,the 
observed  differences  between  valuee  for  the  same  sample  size  and  Y/d 
ratio  can  bo  considered  to  be  due  to  random  error.  The  three  values 

in  the  tables  were  therefore  arrayed.  It  can  be  seen  that  within  the 
estimate  of  random  error  noted  above  the  values  of  G  for  larger 
samples  agree  with  the  theoretical  values.  As  the  sample  size  de¬ 
creases  the  value  of  G  increases.  The  values  of  H  also  agree  well  for 
large  samples.  However,  for  values  of  Y/d  of  1,0  and  2.0,  the  value 

of  H  deciaasea  for  small  samples.  This  is  due  to  the  fact  that  in 

these  cases  the  step  is  so  small  that  the  test  does  not  have  time  to 
cover  the  full  range  of  levela  before  the  sample  is  exhausted.  The 
result  is, therefore, that  an  artificially  precise, but  quite  inaccurate, 
determination  is  made  of  gamma. 

Effect  of  Starting  Level 

45.  The  effect  of  a  poor  choice  of  starting  level  was  investigated 
b>  Monte  Carlo  runs  in  which  the  mean  of  the  population  was  at  25. 

The  starting  point  of  the  tost  was  kept  at  20.0.  As  might  be  expected, 
the  value  of  the  mean  as  computed  from  the  Bruceton  teste  tended  to  be 
near  the  starting  point  when  a  small  number  of  items  was  tested  and 
also  for  a  large  value  of  the  ratio  Y/d,  that  is,  when  the  distribu¬ 
tion  function  was  relatively  flat.  When  a  snail  number  of  items  in 

tested  the  estimate  of  the  dispersion  parameter  is  too  small  and  shows 
more  variation  from  sample  to  sample  than  would  he  expected  rvom  the 
large  sample  theory.  The  results  are  given  in  Tables  C-4,  C-8,  C-12, 
C-1S,  and  C-20.  The  comparative  effect  on  the  mean  is  shown  for  threa 
Btep  sizes  in  Table  9  which  gives  the  values  of  (u  -  mB)/Y  and  the 
corresponding  true  percent  response  of  the  estimated  fifty  percent 
point.  The  effect  on  the  value  of  gamma  is  shown  in  Tables  10  and  11. 
Table  10  gives  the  values  of  the  bias  factor  Comparison  with  the 

values  of  this  bias  found  in  tests  with  better  choice  of  starting  point 
shows  little  difference.  Table  11  gives  the  values  of  H,  which  is  a 
measure  of  the  variability  of  the  estimate  of  gamma.  It  will  be 
seen  that  for  small  samples  these  are  larger  than  when  a  good  choice 


NOLTR  7.3-91 


Table  7  effect  of  Sample  Si?#  on  valjft  of  C 
_ l _ 1/d.JLOJ _ 


Sample 

^ •‘19. 5 

>.*20.0 

*-20.5 

average 

10 

2.6980 

2.5871 

2.7994 

2.6948 

20 

2.4133 

1.9499 

2.0331 

2.1321 

50 

1.7944 

1,7714 

1.9556 

1.8536 

100 

1.6856 

1.5412 

1.8502 

1.6923 

500 

1.9019 

1.5720 

1,4675 

1.6471 

Infinite 

- 

- 

AuSl.?— 

v/d  -  1.0 


Sample 

■BIB 

^-20.0 

►*-20 . 5 

average 

10 

3.4533 

2.6696 

3.2983 

20 

2.1599 

2.1014 

2.0653 

2 . 1089 

50 

1.8659 

1.7569 

1.5375 

1.7201 

100 

1.7452 

1.7947 

1.7345 

1.7581 

500 

1.3624 

1.7222 

1.4635 

1.5160 

Infinite 

.. 

v/d 

-  2.0 

Sample 

ggy| 

►>■20.0 

*-20.5 

10 

3.1579 

3.5380 

3.6335 

3.4431 

20 

2.5096 

2.7503 

2.3119 

2.5239 

50 

1.7646 

1.7569 

1.5577 

1.6931 

100 

1.6388 

1.6205 

1.4989 

1.5861 

500 

1.5508 

1.4057 

1.5202 

1.4922 

Infinite 

- 

- 

- 

1.501 
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Table  8  Effect  of  Sample  Size  on  value  of  H 


l— _ 

>/d 

-  0.7 

--19.5 

u-20.0 

u-20.5 

averaqe 

10 

2.4122 

1,7636 

1.4802 

1.8853 

20 

1.7724 

1.3645 

2.0666 

1.7345 

50 

1.7218 

1.6561 

1.7294 

1.7024 

100 

1.4804 

1,7171 

1.4852 

1.5609 

500 

1.5743 

1.5356 

1.6419 

1.5839 

Infinite 

- 

- 

msflii 

_ vA? 

■  l.o _ 

Hum 

u-20.0 

■rosm 

averaqei 

10 

1.9087 

1.5656 

1.7838 

20 

1.7603 

1.7916 

1.5060 

1.6926 

50 

1.6482 

1.8939 

1.9407 

1.0276 

100 

1.4554 

1.7629 

1.7095 

1.6426 

500 

1.6723 

1.9354 

1.8860 

1.8312 

Infinite 

- 

- 

- 

1.745 
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of  atarting  lavel  was  made .  Similar  effectB  were  obaerved  in  Monte 
Carlo  tasta  with  populationa  having  a  normal  diatribution. 
(Rafaranca  8) . 


Tabla  9 

Effact  of  Poor  Starting  Point  on  Datarmination  of  tha  Maan 

(Tabla  givaa  valuta  of  (i*  -  m«) /y  balow  tha  lint 
and  tha  corratpondi.ng  trua  ptrcant  point  abova 
tha  lina  for  y/d  valuta  of  0.7,  1.0,  and  2.0) 
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Table  10 

Effect  of  Poor  Starting  Point  on  the  Determination  of  Gamma 
(Values  of  the  Bias  Factor  gg/gfi) 


0.7 

1,0  __ 

2,0 

10 

1.6500 

1.3934 

2.4678 

20 

1.1288 

1.0028 

1.0211 

50 

1.0649 

0.9842 

0.9453 

100 

1.0200 

1.0162 

0.9655 

500 

0.9881 

1.0104 

1.0158 

Table  11 

Effect  of  Poor  Starting  Point  on  Value  of  H 
(Values  of  the  Bias  Factor  <?B/gB) 


SamDle'sTs*-^^. 

0.7 

-1.0 

-2.0  _ 

10 

3.2567 

3.3538 

2.9715 

20 

2.2232 

2.4274 

2.4228 

50 

1.7776 

1.9905 

2.0749 

100 

1.6393 

1.8627 

2.2386 

500 

1.7682 

1.6963 

2.0778 
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Choice  of  Step  Size 

46.  Some  generalizations  can  ba  mad  a .  Tha  choica  of  tha  atap  aiza 
to  ba  used  in  tha  taat  depends  upon  what  is  already  known  about 
tha  distribution  and  upon  whether  we  are  more  interaated  in  deter¬ 
mining  tha  fifty  percent  point  or  the  value  of  gamma.  Tha  following 
points  should  be  noted. 

a.  For  large  steps  (larger  than  five  times  gamma)  the  value 
of  gamma  becomes  indeterminate  if  the  fifty  percent  point  falls  on 
a  teat  level  (Figure  7)  .  For  this  reason  large  steps  should  ba 
avoided  unless  tha  position  of  the  fifty  percent  point  is  at  least 
approximately  known. 

b.  A  small  step  sice  would  not  ba  good  with  a  taat  of  as 
few  aa  twenty  items  unless  we  can  be  sura  that  tha  starting  level 
is  near  the  population  fifty  per  cent  point.  For  example  sea  the 
Monte  Carlo  determination  of  tha  fifty  percent  point  for  tests 

of  twenty  items  with  the  population  mean  at  25  and  a  value  for  gamma 
of  2.5.  Here  the  starting  level  is  at  tha  12  percent  point  of  the 
population  and  the  step  aize  (d/y)  is  0.4.  The  average  of  the 
Bruceton  means  was  23.827  which  la  the  38.5  per  cent  point  of  the 
population. 

47.  The  precision  with  which  the  values  of  the  mean  and  gamma  can 
be  measured  under  ideal  conditions  for  different  step  sizes  can  bo 
deduced  from  the  shape  of  the  G  and  H  curves  (Figures  "  '  ’')■  . 

a.  The  values  of  G  show  that  the  most  precise  measurements 
of  the  mean  are  obtained  for  small  steps.  However  these  ideal 
conditions  are  not  ordinarily  met.  As  we  have  just  shown  a  small 
step  gives  a  poor  estimate  of  the  mean  when  we  have  a  short  test 
with  a  poor  choice  of  starting  level. 

b.  The  minimum  value  of  H  occurs  when  v/d  is  equal  to  0.5  if 
the  mean  is  on  a  test  level  or  0.2  when  the  mean  is  midway  between 
test  levels.  This  gives  the  most  precise  determination  of  gamma 
when  the  step  is  two  to  five  times  the  value  of  gamma  depending 
upon  the  position  of  the  mean  with  reapect  to  the  test  levels.  If 
we  know  the  mean  well  enough  so  that  we  can  be  fairly  certain  that 
it  is  nearly  halfway  between  step  levels  and  if  we  expect  to  test 
enough  items  to  obtain  a  good  determination  of  the  response  at 

the  two  levels  neareat  the  mean  a  etep  aize  as  large  as  five  times 
the  expected  value  of  gamma  will  be  best  for  measuring  the  dispersion 
parameter.  In  this  case  we  would  be  testing  at  the  estimated  8  and 
92  percent  points.  This  would  mean  that  the  test  should  include  at 
least  fifty  items  if  we  expect  to  get  fairly  good  estimates  of 
these  points.  If  we  cannot  tesu  as  many  as  this  a  smaller  step 
size  must  be  chosen. 


i 
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APPRHDZX  A 

Appendix  A  Is  a  summary  of  the  prooaaa  for  carrying  out  a 
logistic  Bi jcaton  analysis.  Figura  a-1  is  a  flow  chart  giving  tha 
various  oparatlona  and  equations  to  obtain  x,  g,  eB,  and  e^. 

Figures  A-2,  A-3 ,  and  a-4  praaant  graphically  tha  varioua  relation¬ 
ships  needed  for  tha  computations  called  out  in  tha  flow  chart. 
Tablet  A-1,  A-2,  and  A-3  from  which  Figures  A-2,  A-3,  and  A-4 
ware  cone true ted,  can  be  uaad  for  greater  accuracy.  Table  A-4  la  a 
compilation  of  the  aquations  naadad  to  compute  any  daairad  response 
stimulus  level  and  associated  one-  and  two-sided  confidence  limits. 
Tha  student  t  approximation  equation,  and  constants  for  varioua 
percentage  levels,  are  also  included  in  this  compilation. 


A-1 
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FIG  A -3  VALUES  OF  G  AS  A  FUNCTION  OF  D  AND  E 


■w*r 


A— 1  TABULAR  VALDES  OF  THE  OORKBCTICB  FACTOR  6 


NOLTR  73-91 


^ 

9?  9? 


,,§M 

•  •  •  • 

9??? 


100000 

I  t  I  I  I 

99??? 

100000 

I  I  t  I  I 

99??? 


OOW  t—  f*i  on 
fco  cr\  O  u~ 
Q-S  O  OJ  CM 
H  O  C  O  o  o 

I  . 

QO  O  O  O  O 

II  I  +  +  + 


H  O  ! —  CO  H  ^ 

H  OSO\  H  Ol  O  IA 

UfS  H-=t  r-  O  W  w 

oj  H  a  o  o  o  o 

•  i  i  i  i  ■  > 

O  O'  J o o  o 
T  ,  i  +  +  + 


Ol  O  0<5 

H  aO  CM'P 

& 


•  l  o  o  o  o 

•  t  ♦  • 

9??? 


8  .£33o3 

•  1  «  1  1  1 

o 


•00000 

k  »  I  I  I 

9  9??? 


§  M§8& 

d  <V9  99?? 


e 


H  ?n  !C'i 

1  IOOOO 

it** 

9??? 


HI  I  I  O  O  O 

•  I  •  •  • 


9??? 


.$3388 

iiii* 

99??? 


«  liiiif 

•  •  •  •  J  J  J 


.  .  3S>S"g 

•  •  •  • 

9  ?  ?  °i 


.  ,  8  g  S- 


9??? 


«?a«s 

ii>ii 

99??? 


£  tmw 

d  mm 


0000 
•  •  •  • 

9??? 


1  1OOOO 

I  I  I  I 

9??? 


O  O  OOO 

lilt* 

99??? 


9999?? 


H'fiH 


1  10000 

tit* 

9??? 


0 

I  IOOOO 
•  •  •  » 

9??? 


0000 

I  I  ‘  • 

sss? 


»  IOOOO 

•  •  •  • 

<???? 


II 

I  I  O  o 


??? 


p 

H  I  I 


Q  H  H  f- 


9??? 


I  IOOOO 

lilt 

9??? 


S|  .  .IIS? 

o  9  ?  ?  9 

Q  5\  CM 

2  ,  ■  3S3S 

•  •  1  1  • 

0  9??? 

ir\J  8  £a  P-9 

»  .  ,  38SS 

«  1  •  •  • 

0  9??? 


b  o  o  o  o 

•  till 


99???  ol  9999?? 


fc-  H  H  C\J  2*1 
lOOOOO 

111*4 

9  9??? 
,83382 

•  •  •  •  t 

999?? 

lOOOOO 

1  1  1  1  1 

9  9??? 


jhH  H  mn 

lOOOOO 

•  iiit 

99??? 


0!  99^$$ 

m  eg  c\j-i 

»  iflfiS 

•  •  •  *  •  *  ■ 

0  99999? 


j*  ro<— i  fi  ia  fc-  eo 

Av  <r*o  h  OsO  j 

OJ  Qvj  rH  O  OJ  OJ 

•  OO  OOOO 

O  ...... 

QO  OOOO 
II  I  +  +  + 


rr)r-l  so  lA  f-A 
00  — i  O'  ^  lA 

\r\  {Sir  h  o  v.  ev 
OJ  000000 

d  cfooo^ 


O  H  OJ  m  ^  lA 
•  ••••• 
O  O  O  O  o  o 


OH  N  rojf  lA 

...... 

OOOOOO 


0  h  cm  m-e  ia 

...... 

OOOOOO 


O  H  CM  CH-J- 
•  ••••• 
OO  OO  00 


A-l{  Continued)  TABULAR  VALUES  CP  THE 


RQLTR  73-.U 


tv 

a 


H 


°l  <?<?<???$ 

si  fffiSf 

•I  •  •  II,,  »l  w»  "i  w»  wi  'I  w.  "\!  ^  ^  ^  ^  ^  w  Lr'N 

ol  999*33  o|  o|  999333 


•  ••••* 
9  91???? 

H  H 


rn\Q  q  w 

'h  S' 

o  o 

■  *>••• 


ai 


°i  o 


LA 

ft 


•  •••%# 


T 

X 


OHM  on  -tf  y\ 
04  •>•■•! 

o  o  o  o  o  o 


<?<?<????  ° 


OH  N  m 
!•••»• 

o  o  o  o  o  o 


wl  8888  8  8  K| 


=??<????  O 


O  H  (V  mjtf  IA 
•  ••»•• 

o  o  o  o  o  o 


9  <?  <?  ?  ?  ? 


O  H  CVI  M4  IA 

«  t  i  i  i  • 

o  o  o  o  o  o 


A-7 


MOTE:  Values  which  are  indeterminate  are  indicated  by 


TAHLK  A- 2,  TABDLAR  VALUES  {7  G 


s  amts 
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TABLE  A-4  COMPILATION  01'  EQUATIONS  NEEDED  TO  COMPUTE  THE 
LOO IT  RESPONSE  LEVEL  AND  CONFIDENCE  LIMITS 


l.  To  eonpute  response  stimulus  level,  Xpj  probability  of  response  it  p. 

*P  ■  5  ♦  fin  ( Jj)  ■  2  +  g‘U  x) 


L(x)  ■  la  (-£-) 

1-p 

2.  To  compute  the  standard  deviation  of  Xp. 

.p  ■  vrgr  * 

3.  To  approximate  the  value  of  Student* a  t. 


t  .  R  +  — L- 
8f-V 


4. 


Single -Sided 
Confidence  Level. 

P  (*)  . 

R 

8 

V 

Two-8ided 
Confidence 
Level  P  (*) 

Usable 

for 
f  * 

90 

1.2620 

1.2229 

1.13*5 

80 

9 

95 

I.6I+50 

0.6602 

0.6279 

90 

7 

97.5 

1.9600 

0.4210 

0.4774 

95 

6 

99 

2.3260 

0.26687 

0.3796c 

98 

7 

99-5 

2.5760 

0.20276 

0.33618 

99 

7 

To  compute  two-elded  Interval  about  Xp  at  a  confidence  of  P$> 


(L,U)  -  C(*p  -  t*»p),  (Xp  +  t*ep)  ]; 

At  the  50f>  point! 


(L,U)  -  [(2  -  t'ig),  (x  +  t-ej], 

5.  To  aempute  the  lover  tingle- aided  limit  at  a  confidence  of  P$: 

(L)  -  Xp  -  t *  Op  . 

6.  To  compute  the  upper  single-sided  limit  at  a  confidence  of  P$: 


(U)  -  Xp  +  t *  Sp  . 
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APPENDIX  B 

DERIVATION  OF  VARIOUS  MOMENTS  OF  THE  LOGISTIC  DISTRIBUTION 


1.  Ordinarily  tha  logiatic  diatribution  li  axpraaiad  in  tha  cunrulativa  font 


L(x)  -  la  .  *±  ,  (B-l) 

1-P(  *)  V 

vhara  p  la  tha  ouaulatlva  probability  at  a  atiaulua  laval  of  x.  Tha  p.d.f. 

( probability  danaity  function)  la  dafined  aa  tha  darlvativa  of  the  ouaulatlva 
probability! 

r<*)  -  #.*)  .  d[p(x)]  (b-p) 

dx  dx 

Equation  (B-l)  oan  ba  aolvad  for  p  to  giva 

p(x)  -  -*L  > _ i _  ,  vhara  (B-3) 

i+ey  i+a-y 


y  .2£  . 

V 

By  lotting  u  -  1  +  a“y,  tha  aquatlona  oan  ba  oada  laaa  avkvard  to  vrlta 


Tha  p.d.f.,  than,  baoomaa 

and  tha  individual  darivativaa  can  ba  aaan  to  ba 

dy  1 
dx  "  V  * 


du 

Hy 

&[p(x)3 

du 


.*”y,  and 


u 


Thua, 


-  p.d.f.  .  (ij  (.-y)(i) 

u  v 


(B.4) 

(B-5) 

(B.6) 

(B-7) 

(B-8 

(B-9) 


B  .1 
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1  (  *'y  ! 
v  U^e-y+e”2^ 

(B-10) 

1,1 

7  2»a(,«yy,y:) 

(B-ll) 

( - 1  - .  .  ) 

2Y  '  If co*h(  y) ' 

(B-12) 

—  (  ) 

*  l+co rt(£Z) 

(B-13) 

2.  The  integral  of  the  p.d.f.,  between  the  limits  of  -•  end  should  be 
equal  to  1  for  a  well-behaved  distribution  function: 


Ai 


-r' 

~  P 

2y 


dx 


.it*  «ou(Hj 


(B-14) 


since 


x-u 


dy  ■  Si 
V 


t®  A 

. 1  i  T-Ar-— 

7  j  l+cosh  y 


(B-15) 


-Si 


J  2  +  y 


^7=7 


(B-16) 


let  w  *  ey*  dw  «  P'dy 


(B-17) 


y/  Malts 

A 

x  y 

V 

+*  +* 

■f® 

1 

• 

1 

8 

i 

0 
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3.  By  definition,  the 


-  -0  -  (-1) 

•  1* 1 < 1Q1E1D1 

should  b#  tht  first  aoment  shout  ths  origin! 


mean  >  J  (p.d.f.)xdx  . 


(B-18) 


In  our  notation  ve  should  be  able  to  shov  that  M)  equals  u.  Sine*  x  -  u  +  Yy 
equation  (B-18)  be  com  a 


m.  .±  iHlttLfr: 

g  ^  1+eosh  y 


if- — ^ +  2  f— 2L5aL-  • 
1+ecsh  y  1+cosh  y 


(B.19) 

(B-so) 


But  the  seaond  ten  is  an  odd  function.  The  integral  of  an  odd  function  between 
Units  vhich  are  synnetric  about  zero,  is  itself  zero.  The  first  ten  of  the 
above  equation  Is  the  uae  as  equation  (B-15),  Bultlplled  by  n.  Hence 


Hi  ■  uAj  -  h  Q.S.D. 

U.  By  definition,  the  variance  should  be  the  second  oxnant  about  the  meant 


*  -cr*  ,  )(x  -  nean)*dx 


(B-21) 


i  r  (x-u)*dx 

l+cosh(5di/ 


(B-22) 


Again,  since  x  ■  u  +  Yy  the  preceding  equation  becooes 


T*  ■  £  r  — .  ,  and 
2  J  1+cosh  y 


Y*  J 

»  T  AAA* 


1+cosh  y 


(B-24) 


(B-23)  j 
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but, 

i  2«y 

(W).  ' 

and  thus 


(8-25) 


a*  .  2y* 


«• 

I 


a££fli  . 

( aJ+i)# 


(B-26) 


By  b ranking  (B-26)  into  jr*  and  and  integrating  by  part*  tha  aapraaaion 

becooaa  ( a^Vl)* 


a*  ■  2y*  Ld£  - 

L*y+i 


But  tha  tara, 


la  saro  at  y  ■  o  and  beccaaa  aaro  aa  y 


“I  tfcua 


If  nov  y  la  tranafomad  by  y  -  In  u,  than  dy  •  Q  and 


lat 


o*  -  . 

J  u(l*u) 


0» 


* 

I 


(-In  v)( ‘  ”jf) 

7^4) 
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In  v  Av 
1+v 


Breaking  thii  into  In  v  and  and  integrating  by  parti,  ylelda 

1 

o*  -  ^[-(la  v)ln  (1+y)  +  J  dv 

J  v  o 

Tha  tarn  (in  v)ln  (l+v)  la  taro  when  v  ■  1  but  beeooee  indeterminate  at  v  ■  o. 
By  rewriting  tha  tarn  in  tha  fora 


In  v _ 

1 

In  ( 1+v) 

and  applying  l'Hoapital'a  rula  va  find  that  tha  tern  alio  vanlahaa  at  v  -  o. 
Hence 

1 

o*  -  hy*  J  lalLl+v)flv  . 


How,  a  wall  known  aeriea  exist a: 

u i+v )  . 

1  T  3 

Tha  integral  between  tha  Unite  of  zero  and  one  givaa 

1  1 
f  v  _  vf_  ^  V 4  . 1  .  TT* 


Thera  fora 


d*  • 


?  f 


12 


and  o 


TT 

V?  Y 
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5.  The  proceeding  derivation  of  the  variance  of  the  logietic  distri¬ 
bution  was  performed  by  Dr.  A.  H.  Van  Tuyl  of  thia  Laboratory. 
Independent  of  hia  effort  were  two  other  piecea  of  work.  One  of 
these  waa  a  derivation  of  the  variance  (by  Mr.  Blum)  following  a 
markedly  different  chain  of  logic.  The  other  waa  an  experimental 
verification  using  a  high-speed  Monte  Carlo  simulation.  A  description 
of  the  second  derivation  and  of  the  Monte  Carlo  experiment  follow, 
in  that  order. 


b. 


c* 


Derivation  of  Standard  Deviation  of  Logistic  Distribution 


(x-u)9  p (x) dx 
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.  \  n m  rg^azastsiidBtssaazzg"1: 

3  K  1  L  ®in2TTK  J 

•  (l-  ■  Y*  5* -  3.2898  Y* 


Reference;  Apostol,  Mathematical  Analysis.  [Theorem  14-24 1] 

The  order  of  differentiation  and  Improper  integration  may  be  exchanged 
under  the  following  condition®  i 

(1)  Ja  exieta  for  all  a,b  in 

-■  e~yKdy 

(2)  n  .-y.*  converge*  polntwlae  for  all  K  in  [c,d]  for  aome 

-•  1  c,d; 

»•  r  n  v..-yK 

(3)  -2-.  „■  nmat  be  continuous  on  the  atrip 

*1  r  ,-yK  , 

(4)  jTiT  —————  dy  must  converge  uniformly  on  (c,d). 

J-«  L(l+e“y)*J 

(1)  and  (2)  follow  by  limit-comparison  with  e^  for  appropriate  values 
of  p  [theorem  14-4];  (3,  follows  from  the  continuity  of  the  sum. 
product,  and  quotient  of  two  continuous  functions  [theorem  4-10 J ;  and 
(4)  follows  from  a  Cauchy  condition  [theorem  14-18];  if  we  choose  any 
c,  d  satisfying  0<G<d<2. 
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7.  Monte  Carlo  studies  on  asymptotic  convergence  of  the  variance 
of  the  logistic  distribution  function. 

We  wished  to  verify  the  algorithm  for  producing  numbers  distributed 
randomly  in  the  logistic  distribution  and  at  the  same  time  demonstrate  the  nature 
of  the  effect  of  the  saopxe  sire  on  the  sampling  error  of  the  variance. 

We  eeeume  that  ve  knov  the  critical  levela  of  the  devices  being  tested. 
Furthermore,  ve  set  the  population  parameters  to  convenient  values,.,  u  -  0  and 
y  ■  1.  The  logistic  equation  reduces  tot 


L(  x)  -  In  (JL)  -  -  x  . 

1-P  V 


Using  a  high-speed  computer  it  ie  possible  to  generate  e  sequence  of  numbers 

Pt>  P*>  P**  P« . which  have  the  property  of  falling  between  the  limits  of 

zero  and  one  and  having  s  fact  angular  distribution.  That  is,  if  any  particular 
value  la  chosen  between  aero  and  one  that  value  will  be  the  seme,  in  the  limit, 
as  the  decimal  fraction  of  the  numbers  that  will  be  generated  which  will  fall 
between  zero  and  that  particular  value.  For  inBt&nce  if  a  value  of  .35  is  chosen 
and  if  many  hundreds  of  the  random  numbers  are  generated  and  classified  according 
to  whether  they  are  larger  or  smaller  than  .85  ve  vlll  find  that  85  out  of  100  on 
the  average  will  fadl  in  the  lower  classification. 


The  random  rectangular  distribution  was  converted  to  a  random  logistic 
distribution  of  values  of  x  (with  a  U  of  C  and  a  V  of  l)  merely  by  letting 


In  the  Monte  Carlo  experiment  100  trials  were  run  on  each  of  9  sample  sizes  where 
the  sample  size,  N,  took  values  of  15,  20,  1*0,  60,  80,  IOC,  200,  500  and  100C.  For 
each  trial  of  N  a  samples  a  variance  was  computed  using  the  equation 

J 


Ex3  . 

nr 


V1 


When  one  hundred  such  variances  ha  been  obtained  the  average  of  these  was  confuted 
as  well  as  the  95$  confidence  band  about  the  average.  We  also  noted  the  smallest 
and  largest  value  of  v  for  each  of  the  9  different  sample  sizes.  The  observed 

values  given  in  Table  3-1  have  been  plotted  in  Figure  B-l.  To  facilitate 

cocparison  with  the  theoretical  value,  I?/3<  the  observed  values  normalized  by 
dividing  by  na/3> which  is  3.26967,  are  also  tabulated. 
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TABLE  £-1 

ASYMPTOTIC  CONVERGENCE  OF  THE  LOGISTIC  L'lSTRIBUTION  FUNCTION 


N 

Sample 

Size 

Observed 

Mini  son 

Lower  Lindt 
of  95% 
Confidence 
Band 

i 

Average 
Variance  for 
100  trials 

Upper  JVLmit 
of  95% 
Confidence 
Band 

Observed 

Maxi mum 

15 

1.070 

2.936 

3.040 

3.143 

8.518 

20 

1.162 

3.161 

3.286 

3.411 

6.736 

40 

1.766 

3.156 

3.260 

3.363 

7.732 

60 

1.893 

3.240 

3.318 

3.396 

6.392 

80 

2.139 

3.288 

3.351 

3.414 

5.099 

100 

1.962 

3.362 

3.428 

3.404 

5.353 

200 

2.362 

3.263 

3.300 

3.338 

4.161 

500 

2.748 

3.268 

3.293 

3.319 

3.906 

1000 

2.779 

3.262 

3.282 

3.300 

3.694 

15 

.325 

.862 

.924 

.986 

2.589 

20 

.353 

.925 

.999 

1.073 

2.048 

40 

.537 

.929 

.991 

1.052 

2.350 

60 

.575 

.962 

1.008 

1.055 

1  .943 

80 

.650 

.981 

1.019 

1.056 

1.550 

100 

.596 

1.003 

1.042 

1.081 

1.027 

200 

.718 

.981 

1.003 

1.025 

1.265 

500 

.835 

.986 

1.001 

1.016 

1.187 

1000 

.845 

.986 

0.997 

1.009 

1.123 

Variance 

Value* 


Variance 
Value* 
formalized 
LO  TT9/3 
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